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The relationship between thermodynamics and statistical physics is valid in the thermodynamic 
limit - when the number of particles involved becomes very large. Here we study thermodynamics 
in the opposite regime - at both the nano scale, and when quantum effects become important. 
Applying results from quantum information theory we construct a theory of thermodynamics in 
these extreme limits. In the quantum regime, we find that the standard free energy no longer 
determines the amount of work which can be extracted from a resource, nor which state transitions 
' can occur spontaneously. We derive a criteria for thermodynamical state transitions, and find two 

^Nj , free energies: one which determines the amount of work which can be extracted from a small system 

in contact with a heat bath, and the other which quantifies the reverse process. They imply that 
generically, there are additional constraints which govern spontaneous thermodynamical processes, 
h-^ , We find that there are fundamental limitations on work extraction from nonequilibrium states, due 

. to both finite size effects which are present at the nano scale, as well as quantum coherences. This 

' implies that thermodynamical transitions are generically irreversible at this scale, and we quantify 

the degree to which this is so, and the condition for reversibility to hold. There are particular 
equilibrium processes which approach the ideal efficiency, provided that certain special conditions 
are met. 

One of the most basic quantities in thermodynamics is the Hclmholtz free energy 

§■ F{p)^{E{p))-TS{p) (1) 

O^. with T the temperature of the ambient heat bath that surrounds the system, S{p) the entropy of the system, and 
(E) its average energy. It tells us whether a system at constant volume and in contact with a heat bath can make a 
spontaneous thermodynamical transition from one state to another. A transition can only happen if the free energy 
J> ■ of the final state is lower than that of the initial state. The difference in free energy between the initial and final state 
, is also the amount of work which can be extracted from a system in a thermal bath. It is also gives the amount of 
CO . work required to perform the reverse process, since thermodynamics at the macroscopic scale is reversible. 
9^ [ However, the free energy is only valid in the thermodynamical limit - when p is composed of many particles and is 
i . classical, in the sense that it is in a state which is a probabilistic mixture of different energies. But thermodynamical 
effects are not only important in the macroscopic regime - they are becoming increasingly important as we probe and 
manipulate small systems from the micro up to the mesoscopic scale. Already, molecular motors and micro- machines [ll- 
@] have been constructed in the lab[7l-[l0| and thermodynamical effects are increasingly important in quantum devices 
and in the construction of quantum computers and memory [TTi [T2|. Likewise, quantum effects have implications for 
thermodynamics p"3l - [T5| . Here, we derive two free energies which are valid even when the thermodynamical limit is 
k>( [ not taken, and even when the system is quantum. We also derive a criteria for state to state transitions, and a criteria 
j_j • for when transitions between two classical states can be made reversible in the micro-regime. 
' We will first consider a quantum system 

p = Y,<^iE,E',g,g')\E,g){E',g'\ (2) 

with a fixed Hamiltonian H and eigenstates of energy E given by \E, g), in contact with a heat bath. We are interested 
in the types of state transitions which are allowed, and in particular, our ability to use the system as a resource to 
extract work. We will then consider the case where the Hamiltonian of the initial and final state is not the same, so 
that the system undergoes a non-cyclic evolution. 

Instead of considering macroscopic work (the pushing out of a piston, or the raising of a weight), we consider 
microscopic work - for example, the exciting of an atom from its ground state to an excited state (Figure [1}. We can 
thus use a two level system to store work. Because the amount of extractable work can be small, we require precise 
accounting of all sources of energy. We thus consider a paradigm where extraction of work, and other operations 
must be done using energy conserving operations [l^, so that any energy which is transferred to or from the resource 
system and heat bath, is transferred from or to the system which stores work. This casts thermodynamics as a resource 
theory^^^, which allows us to exploit some mathematical machinery from information theory. Thermodynamics 
is then viewed as a theory involving state transformations in the presence of a thermal bath. The extraction or 
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FIG. 1: A macroscopic heat engine which performs work by lifting a heavy object a certain height (left). In the quantum or 
micro-regime, we can think of work as the ability to excite a two-level system from one energy state to a higher one (right). 
Having many of these atoms would allow us to perform macroscopic work - for example, we could use the atoms in a laser. An 
amount of work W can be used to produce a transition from the state |0)(0|, to the state |1){1|, with Hamiltonian W — W^|l)(l| 
(we call such a two- level system, the work qubit, or wit). We can use such a system as a basic work storage unit, since our 
results will not depend on what physical system is used. 



expenditure of work can be included in such a paradigm, because it is equivalent to a state transformation - the state 
of the work qubit is raised or lowered from one energy eigenstate to another. We call the class of operations that are 
allowed Thermal Operations - a fuller discussion of which is contained in Section A of the Appendix. 

Having precisely accounted for all sources of energy, we can show in Section D of the Appendix, that the quantity 
which replaces the Helmholtz Free Energy for calculating the extractablc work in the quantum regime is 

Fr"\p) = -fcTinflnV;i(w„g,£;,)e-^^' (3) 

where uj = Pep^Pe with Pe = \E){E\ is the state p decohered in the energy eigenbasis (i.e. off-diagonal terms 
are set to zero), is any state such that [jwe — cli||i < e and h{uif^,g,Ei) is 1 if energy level \g^Ei) is populated and 
otherwise. /3 is the inverse temperature, and k is Boltzmann's constant. The significance of e is that it takes into 
account the situation where we allow a tiny probability e of failing to draw work[22|. In terms of information theoretic 
quantities, we can write 

Fr''{p)-Fr-{T) = TDl^Mr) (4) 

, where /^^^^(wllr) := — infj^^, Intr Ilj^^r is the min-relative entropy [23j with 11^^ the projector onto the support of 
We and r is the Gibbs state t = Z^^ e^^^\E^g){E^g\ with partition function Z. The min-relative entropy and 
single-shot free energy has been independently introduced to quantify work extraction from classical states using a 
model of a series of independent interactions with a heat bath|24l| 

In the thermodynamical limit Dmini.pW'T) becomes [25j S{p\\t) the relative entropy S{p\\t) := — trplogr + trplogp. 
Thus, while the maximum amount of work W which can be extracted when a macroscopic system is in contact with 
a heat bath, is W{p) = F{p) — F{t), more generally it is ly = i^™™(p) — F™™{t) and only in the thermodynamical 
limit do we recover the traditional result. 

Although the quantity of Equation ^ looks very different to the Helmholtz Free Energy, it can be compared to it 
easily in the situation where the system's energy fluctuations SE arc small compared with the average energy (E) as 
is the case with macroscopic thermodynamical systems. We then find by Taylor expanding Equation ^ and taking 
the zeroeth order approximation that 

F™™(p) w sup[(£;) - A:Tlnrank(a;e)] (5) 

In the case where the system is diagonal in the energy eigenbasis i.e. 

P= <^E.g.s'\E,g){E,g'\ , (6) 

E,g,g' 

we have that p = u. Then, for extensive systems and the case of many particles n, the quantity lnrank(ci;e) ^ 
Inrank(pe) « S{p) [25| with e going to zero exponentially fast in n. We then have that Equation ([5]) approaches the 
Helmholtz Free Energy. 

In general however, infp^ rank(pe) is larger than the entropy S{p), especially in the case where we just have a single 
system in the micro-regime, meaning that F""" is smaller than the free energy. The finite size of the system means 
that less work can be extracted. 
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There is a second reason why a hmitation exists on the amount of extractable work. A quantum system p needn't 
be in the form of Equation ^ and in particular can have off-diagonal terms connecting different energy eigenstates. 
However, it is not p which enters into Equation ([3]), but rather the state p decohered in the energy eigenbasis, namely 
Lo. Thus, to zeroeth order, rather than the rank of replacing the entropy, it is the rank of pe dephased in the energy 
eigenbasis that replaces the entropy. This quantity is generally larger than the rank of p^ which is why for systems 
with quantum coherences of energy, there is a further limitation on how much work can be extracted. As an example, 
consider the pure quantum state 



E.g 

It has entropy and rank equal to zero. However, when dephased in the energy eigenbasis to produce w, it becomes the 
Gibbs state, and has free energy —kTlnZ; no work can be extracted from it, despite it having zero entropy. However, 
as we approach the thermodynamic limit, the coherences matter less and less, and the free energy in the quantum 



case approaches the free energy for classical states[21|, and again, Fmin approaches the Helmholtz Free Energy. 

The fact that at the quantum or nanoscale one can't extract the work as given by the free energy, implies that there 
is an inherent irreversibility in thermodynamic transformations. This can also be seen as follows - the maximum 
amount of work which can be extracted from a system p in contact with a heat bath is given by Fmin{p) — Fmin{T). 
In the process, the system is transformed from state p to the Gibbs state r. But if we wish to use work to perform 
the reverse process, namely transform Gibbs states into p using work, then we show in D of the Appendix that the 
amount of work which is required is — p^°-^[j) with 

prnax ^ ■ j^g iTmi{X : p < \t} - kT \n Z (8) 

in the case where p is diagonal in the energy eigenbasis. In general, F™™ < p-^a-^ ^ go that at the nanoscale we can gen- 
erally extract less work from a resource than is required to create the resource, leading to a fundamental irreversibility 
in thcrmodynamical processes. In terms of information theoretic quantities, Fp'^^{p) — pmax^^-^ _ TDmaxi^pWT); 
where -Dmaa:(p||''") '■— logminjA : p < Ar} is the max-rclative entropy [2^. As we approach the thermodynamic limit 
pmin prnax ^ g^^^ reversibility is restored [25|. 

More generally, we would like criteria which tells us whether one state can be transformed into another under 
some thcrmodynamical process. As we have seen, because of finite size or quantum effects, the decreasing of the 
free energy is not a valid criteria which determines whether a thermodynamic transition can occur. For transitions 
between a system p and a system a, both diagonal in the energy eigenbasis, we can derive such criteria, which we call 
thermo-majorization. It is based on the majorization condition for state transformations which is a necessary and 
sufficient condition for state transformations under permutation maps. It's construction is given in Section C of the 
Appendix, and we state the result in Box [2] 

In the case where p is not diagonal in the energy eigenbasis, but the final state a is diagonal, then transformations 
are possible if and only if transformations are possible from a; to tr. The reason is simple - dephasing in the energy 



eigenbasis commutes with Thermal Operations 2l| since the latter must conserve energy. Since we can dephase the 
final state without changing it (as it is already diagonal in the energy basis) we can use the fact that dephasing 
commutes with our operations to instead dcphasc the initial state without changing whether the transformation is 
possible. 

In the case where the final state is also non-diagonal in the energy basis, the criteria for which transformations are 
possible depends on the coupling one has with the system, and especially, the degree of control one has of the system. 
Thus far, our results have not depended on having fine-grained control of the system and heat bath - the interaction 
depends on macroscopic variables such as total energy E, but the mapping between microstates g does not matter [2]|. 
This is not necessarily the case during the formation process of states with off-diagonal terms. Thus, while Equation 
^ for the extractable work holds in general, the same is not true of Equation ([5]) for the formation process. This 
is because for the formation process of transforming Gibb's states into a state p which is not diagonal in the energy 
eigenbasis, it is generally not possible to make such a transformation using Thermal Operations without additional 
resources. In the case of formation of many copies n of p, the additional resource can be two level pure states in a 
superposition of energy levels[2lj, and the number of them required is sublinear in n and hence vanishes as a fraction 

of 71. 

So far we have considered transitions between the states of a system with fixed Hamiltonian. This might suggest that 
our approach does not cover the microscopic analogue of thermodynamical processes between equilibrium states with 
different initial and final HamiltoniansQ, such as isothermal expansions of a gas in a container. Yet, fundamentally, a 
time dependent Hamiltonian is only an effective picture of a fixed Hamiltonian of a larger system, and we shall show 
below how to describe such transitions in the microscopic regime. 
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FIG. 2: Consider probabilities p{E, g) of the initial system p to be in the g'th state of energy E. Now let us put p{E, g)e in 
decreasing order p{Ei, gi)e~^'^^ > p(£^2, 52)6""^^ > p{E3 iffs)^ ■■■ ~ we say that the eigenvalues are /3-ordered. We can do 
the same for system a i.e. e~^^^g{Ei, gi) > e~^^^q{E2, g^) > e~^^^q{E3, gs).... Then the condition which determines whether 
we can transform p into a is depicted in the above figure. Namely, for any state, we construct a curve with points k given by 
{'^e~'^^' /Z,'^'^ Pi}. Then a thermodynamical transition from p to a is possible if and only if, the curve of p lies above the 
curve of a. 

Namely we introduce a qubit on system C which we can act on to switch the Hamiltonian from H to H' (we call 
this the switching qubit). We can for example take the total Hamiltonian to be 

Htot = |0)(0|c®i/+|l)(l|c®i/' + VK|l)(l| (9) 

and take the initial state of the work qubit, switching qubit and system to be |00)(00|cvy ® P and final state to be 
1 11) (11 lew (7, so that we are effectively changing the Hamiltonian acting on p, and gaining or losing work in the 
work qubit when we make the transition to a. We now consider a transitions between p and r', and want to know 
what value (positive or negative) for W allows us to make this transition. 

The results, obtained by means of thermo-majorization are depicted in Figure [3l One finds 

ly = F™"(a;)-F™"(r') (10) 

for extracting work, and for the amount of work required to form p (provided it is diagonal in energy eigenbasis) from 
the thermal state, we obtain 

^ ^ prnax^p^ _ praax ^^f^ 

This result does not depend on the form of the Hamiltonian of Equation ([9]) - we only require that at late times, 
there is no interaction between the work qubit and the other systems (since we need to be able to separate out the 
work qubit to use in some future process). 

To derive Equations pO)) - pT|) . we /3-order the and g, corresponding to |00)(00|, and cr® |11)(11| respectively. 
Then the thermo-majorization coordinates k oi p® |00)(00| are given by e~^^\Yl\Pi^ }i ^-nd those of cr 8) 1 11) (11 1 
are e~'^(^i+^), g^, }. The thermo-majorization condition for a transition is that for all fc, the points associated 
with p are above that of a and they take a particularly simple form when either p or ct is the thermal state. These 
two cases are shown in Figure [31 The case where the final state is thermal for Hamiltonian H' , a = t' , and the work 
qubit is excited corresponds to distillation, since no further work can be drawn for fixed H' once the state is thermal, 
and a transition to another state can always be followed by a transition to the thermal state. Therefore drawing work 
by relaxing the state to a thermal state is completely general, and gives us Equation PU)) . If p has off-diagonal terms, 
then the distillable work is given by the decohered version cj in Equation PTT]) , due to the same reasoning as we used 
earlier - the final state is simply the work qubit, since everything else can be thrown away, and therefore is diagonal 
in the energy eigenbasis. Since decohering the final state doesn't change the final state, and decohering with respect 
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FIG. 3: Distillable work and work of formation, (a) Graphical representation of two free energies. For Gibbs state 
they coincide. (b),(c): The scenario of changing Hamiltonian we can mimic by adding to the system S ancilla C switching 
between initial H and final Hamiltonian H' , with partition functions Z,Z', respectively. We consider transition p ^ t' and 
r' — !> p, and obtainable works denote by Wdist and Wdist respectively. The works can be of either signs. Adding/Subtracting 
work to a Gibbs state is graphically represented as changing the its slope. Formation is depicted by arrow going from p to 
r', distillation by arrow going from r' to p. The directions of arrow to the right/left means that the work is positive/negative 
in given transition. Positive work, means that we obtain work during the process. We depict two out of possible four cases 
of work signs: (b) both works are negative (c) work of formation is negative while work of distillation is positive, (d) The 
interconversion of two arbitrary states is depicted. 



to the total Hamiltonian commutes with thermal operations, we can do it to the initial state without affecting the 
amount of work extractable. 

The case where we adjust W so that |00}(00|ch' is thermo-majorized by ct ® |ll)(ll|cw gives us the formation 
process, and free energy of Equation (jlO[) . The case where both initial and final states p,a are thermal is also depicted 
in Figure [31 and leads to the ideal classical result, namely that a transition is possible if and only if 

W ^ -T\nZ/Z' (12) 

i.e. the work is given by the difference of standard free energies ([ij . This is a very different result to Equation ([3]) , where 
the work qubit and system have no interaction term as in Equation ([9]) . It shows that for thermal equilibrium states 
there can be reversibility in some thermodynamical processes, provided they are between two thermal equilibrium 
states and the Hamiltonian changes. In the picture of a fixed Hamiltonian, this required at least one additional system 
(the switching qubit), which is effectively not in contact with the heat bath, and we do not draw the maximal amount 
of extractable work from the total working body, given by FJ"™(p5 O |0)(0|(7). The final state is thermal only on a 
subsystem S and therefore the amount of drawn work is not optimal. 

In general, we only get reversibility if there exists a W, such that the thermo-majorization plot of the initial state 
e~^^V-^i Si^Pj}' can get mapped onto the plot of the final state {J2^~'^'"^''^^ ^i}- Thus reversibility 
requires a very special condition. It is this lack of reversibility which requires two free energies. There is a connection 
here with other resource theories. Consider the set of states which are preserved under the class of operations - in 
entanglement theory, these are separable states, and for Thermal Operations, we show in Section E of the Appendix 
that it is the Gibbs state. Now, if the theory is reversible, then under certain conditions, the relative entropy distance 
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to the preserved set is the unique measure which governs state transformations l20l l26f . For Thermal Operations, the 
relative entropy distance to the Gibbs state is precisely the free energy difference [231 ■ Here, in the case of finite sized 
systems, we see that although we don't have reversibility, the relative entropy distance to the preserved set again 
enters the picture, but it is the min and max relative entropy. These quantities are monotonically decreasing under 
the class of Thermal Operations, and provide two measures for state transitions. 
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Appendix A: Thermodynamics as a resource theory 

In the micro-regime, when the amount of work which can be extracted might be of the order of kT , we need to very 
precisely define what we mean by work, and what processes are allowed during the extraction of work from a system. 
For our purposes, obtaining work AVF means to obtain an eigenstate of the Hamiltonian with energy Wout starting 
from an eigenstate of energy Wi„, where Win — Wout = AVF. In our approach it will turn out, that the amount of 
work we can extract from a given system does not depend on the Hamiltonian of the system which stores the work, 
and the particular levels we choose. We can thus consider a system of the smallest dimension, which carries work W . 
This is a two level system with Hamiltonian W — W\1){1\. We shall call this a work quhit (in short, a wit), and let 
\ipw) denote the excited state |1) with energy W . This is the most economical way of storing work. 

Since drawing or adding work can be represented as a state transformation, it is natural to consider thermodynamics 
as a resource theory. Namely, one considers some class of operations, and then asks how much of some resource 
can be obtained. Recent examples of such theories include entanglement theory [2^ [2^, thermodynamics with no 
Hamiltonian jigj . thermodynamics of erasure [soj and operations which respect a svmmetrvfsil i32i]. Here, we use the 
class of operations which corresponds to thermodynamics [U |3^, and then ask by how much we can excite a system 
initially in a pure ground state. It can be shown that there are a number of equivalent ways of describing this class 
of operations [21|. 

Since we are interested in extracting work in the presence of a heat bath, one starts by allowing a free resource of 
a heat bath, with Hilbert space Hr. The heat bath is in a Gibbs state t, with arbitrary Hamiltonian and we further 
allow the addition of any auxiliary system S' with Hamiltonian Hs' in a Gibbs state. Without loss of generality, we 
can take the initial Hamiltonian to be non-interacting at very early times between the reservoir R and the system of 
interest 5*, as well as any ancillas. We also want that initially (and finally), the work qubit is not interacting with 
the rest of the system, since we want to be able to store the work, and use it in some other process. We thus have 
initially Htot =Hr + Hs + Hg, + W. 

We now require that all manipulations conserve energy. This ensures that all sources of work are properly accounted 
for, and that external systems are not adding or taking away work. The dynamics can be implemented by an interaction 
Hamiltonian, however, if we wish to maintain a precise accounting of all energy, then the interaction term needs to 
vanish at the beginning and end of the protocol, otherwise it allows us to pump work into the system at no cost. 
Essentially we need to ensure conservation of total energy. This also means that if we wish to model a time-dependent 
Hamiltonian, we should do so by means of a time-independent Hamiltonian with a clock included in the system. It is 
not difficult to show plj , that all of these paradigms which conserve energy, are equivalent to unitary transformation 
commuting with the total Hamiltonian. Essentially, since accounting for all sources of energy requires that the initial 
and final Hamiltonian are the same, the dynamics must map eigenstates of the Hamiltonian to eigenstates with the 
same energy. This is equivalent to considering a fixed Hamiltonian, and allowing operations which commute with the 
Hamiltonian. We also allow discarding subsystems (partial trace). We call this class - Thermal Operations. 

Note that this paradigm allows one to include time independent Hamiltonians as in the example discussed in the 
Main Section 

Htot = \Q){<d\c ® H + \l){l\c ® H' + W\l){l\ (Al) 

Via a similar mechanism, one can include interacting terms which vanish at early and late times. 

Generally, we are interested in transitions between {ps,Hs) and (as' and Hg') (extracting work will be a special 
case of such a transition). Since in the described approach, the Hamiltonian is fixed, such a transition means actually 
{ps ® Ts' , Hs + Hs' ) — ?> (ts (E> as' , Hs + Hs' ) ■ where we have the same initial and final Hamiltonian. 
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1. Assumptions on heat bath, and its relation to the system 

We also assume that Hamiltonians of all systems of concern (i.e. heat bath Hamiltonian, auxiliary systems, the 
resource system itself) have minimal energy zero. Let be energies of reservoir, and Es be energies of the system. 
Let E'^^^, and E™'^'^ be the largest energy of the heat bath and system, respectively (of course a typical heat bath 
will have E'^'^'^ = 00). 

Our heat bath will be large, while our resource states will be small. This means that the system Hilbert space will 
be fixed; while the energy of the heat bath (and other relevant quantities such as size of degeneracies) will tend to 
infinity. 

We now make some assumptions concerning the state and Hamiltonian of the heat bath. The heat bath is in a 
Gibbs state with inverse temperature /?. Moreover there exists set of energies £r such that the state of the heat bath 
occupies energies from Sn with high probability, i.e. for the projector Pg^ onto the states with energies £r we have 

trP£^PR>l-S (A2) 

and it has the following properties: 

(i) The energies E in Sr are peaked around some mean value, i.e. they satisfy E e {{E) — 0{^JJE)), . . . {E) + 

(ii) For E G £r the degeneracies gR{E) scale exponentially with E, i.e. 

9r{E) > e^^ (A3) 

where c is a constant. 

(iii) For any three energies Er, Es and E'^ such that Er e £r and E's, Eg are arbitrary energies of the system, there 
exist E'j^ e Sr such that Er + Es = E'j^ + E'g. 

(iv) For E E £r the degeneracies gR{E) satisfy gR{E — Es) ~ gR{E)e~^^^ , or more precisely: 

gR{E)e-^^'s 



gR{E - Es] 



- 1 



< S (A4) 



for all energies Es of the system S. 
Discussion of assumptions: 
Ad. Q This is a standard property of a heat bath. 

Ad. (in]) Follows from the condition Q of small fluctuations combined with extensivity of energy. 
Ad. (pli)) Follows from continuity of the spectrum of the heat bath, which is usually the case. 
Ad. (|iv)) Follows from 

g{E + AE) = e^(^^+^^^) 

_ ^S{E)+AE^^ 

= 5(i?)e^^^ (A5) 

with S{E) := ln.g(£;). and /? := 
It is also easy to see that a product r®" of many copies of independent Gibbs states satisfies the above assumptions. 



Appendix B: Notation and preliminary facts. 

We shall now need a bit of notation. Let us define rj^ as a state of a system X proportional to the projection on 
to a subspacc of energy E (according to the Hamiltonian Hx on this system). In particular, i]e-Es is given by 



Ve 



^Es = g{E - Es)-' Es,g)R{E - Es, g\ 



(Bl) 
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where g = 1, .■,g{E — i?s), i.e. rjE-Es is the maximally mixed state of the reservoir with support on the subspace of 
energy Eji ^ E — Eg. We shall also use notation rjx = I/K where the identity acts on a K dimensional space. 
Let us note that the total space Hr ® Hs can be decomposed as follows 

HR®Hs=^(^U§_Es®n%A (B2) 

E \es I 

(here for E < Eg and E > E^^^ + iJ™^'' the summation over Eg is suitably constrained, however we are interested 
only in energies Er from £r, hence these cases will not occur). 

Consider an arbitrary state pRs which has support within E™'"^^ < E < E'^^^. We can rewrite it as follows 

Prs = X! X! PePrsPe+a (B3) 

E A 

Here A = —E™'^'^, . . . ,E'g^^. The blocks PePrsPe+a wc can further divide into sub-blocks 

PePrsPe+a= ^ hi'SS PesPePrsPe+a^r<^ Pes+a (B4) 

where /a = {0, . . . , E^"""" - A} for A > and /a = {-A, . . . , E^'^""} for A < 0. The sub-blocks map the Hilbert 

space n^_Es ® (^Is+A onto n^_E, ^^Ij 
We can then extract the state ps 



PS = PesPsPe's 

Es,E' 



(B5) 



as follows: 

PesPsPe's = X! ^''wi-Es ^^E-Es ® PesPePrsPe+e's-EsPe~Es ® Pe's) (B6) 

E 

We then have the following technical result that will be a basis for most of our derivations: 
Theorem 1. We consider set of energies 

£ = {E:E-Ese £r} (B7) 
where £r satisfies assumptions ([HI and ([m]) listed above. Then 

yE e£ \\ — Pepr ® psPe+a - ®EsVE-Es ® PesPsPesW < 2i5 (B8) 

PE 

and 

Y,PE>l-2S 
Bee 

where pe ~ tr{PEPR ps)- 

Proof. Here we sketch the proof for A = 0. For A ^ the proof is similar. Let us fix an energy block E. Let 
Er = E — Eg. The state tr ® ps restricted to the energy E block is given by 

Petr ® psPe ^^Y. ^'^^ - ^sORiE - EsK'""' ® PesPsPes (BIO) 

^ Es 



where Z is partition function for system i?, and is identity on the subspace see ()B2[) . Using (jlv]) we 

have gR{E - Eg) = gR{E)e-^^'' we get 

I jE-Es 

Petr ® psPe « -^e-"^gR{E) ^ ^ _ <E) PesPsPes (Bll) 
Zr ^ gR{E)e jjEs 

Es 



E-Es 



Since g^(^E)e- isEs ^ Ve-Es- Moreover, if we drop the prefactor, the state is normalised, hence we obtain the claim. 
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Appendix C: Transformations of classical states: condition in terms of majorization 



Here we will provide a necessary and sufficient condition for transforming the diagonal part of a density matrix of 
one state into the diagonal part of another state acting on the same system. The condition will be in terms of the so 
called majorization condition, and it will be necessary and sufficient for state transformations of classical states (i.e. 
diagonal in the energy eigenbasis). The result is contained in the theorem [2j 

From the expression (|B8p it follows that a block of fixed energy E contains only the diagonal part of ps- 

PePr ® PsPe ~ (BesVe-Es ® PesPsPes (CI) 

Note that we can tensor out a maximally mixed state of size independent of both Es and i?, and apply unitarics 
conditioned on the maximally mixed state. We do that by writing 

where K'^^ = g{E — Es)/K. Due to our assumptions about the heat bath, the degeneracy of each energy state is 
exponentially large in energy, so we can take such K that both K and K' are exponentially large in energy. Thus a 
given fixed energy block E can be represented as a tensor product of two systems Rf and R2 in a state 

—PePr (8 PsPe « ^ ®Es ^ ® PesPsPes (C3) 
PE K K^^ 

We know [l^ that then any mixture of unitary transformations can be performed on the system R^^S^ , provided K 
is large with respect to K'^, and we shall choose if, and the size of the total system, in such a way, that this is so, 
and at the same time K'^ can be large too, which we will need further. We shall below use notation rj'^^Es denote 
the maximally mixed state acting on system Rf ■ 

Twirling The following operation being a mixture of unitarics will prove useful. For each fixed Es we apply a 
random unitary to Rf, and identity to the part S^. This operation does not change the final state of the system, 
but greatly simplifies the form of the total state: namely for any initial state on RfS^, the final state is of the form 

^EsV'e-Es^'^Es (C4) 

Finally let us note that we cannot perform any other operation, on the state than a mixture of unitarics, because, 
for the total state of fixed energy block (|C1[) we can only apply some fixed unitary, since in the process of tracing our 
over the reservoir, we will sum over blocks, which effectively performs some mixture of unitarics. However, the state 
with tensored out does not actually differ much from the state ()Cip . as we anyway will take the system Rf to be 
large. Thus the output state coming from a mixture of unitarics performed on the state with and without being 
tensored out have the same effect on the final form of the state of the system S. We should now now recall, that 
the possibility of transforming one state into another by a convex combinations of unitary transformations is simply 
given by the majorization conditions j33j . 

The majorization condition reads as follows: we have two sets of eigenvalues put in decreasing order {Xi} and {A'j}, 
and wc say that {A^} majorizes {A^} when 



^A.>^A: (C5) 



for all I. We say that p majorizes a if the eigenvalues of p majorize the eigenvalues of a. 
In this way obtain the following theorem which will be the basis for our further results. 

Theorem 2. Consider two states ps and as diagonal in energy eigenbasis, on a system with Hamiltonian Hs- The 
transition {ps, Hs) ® (crs, Hs) by means of thermal operations is possible if and only if the state 



majorizes 



^iEsVE-Es ® PesPsPes (C6) 



^EsVE-Es ® (^Es (C7) 



for E large enough. Moreover, if the above majorization relation holds for two states ps and as not necessarily 
diagonal in energy eigenbasis, then there exists a'g such that for all Es Pes'^sPes ~ Pes'^'s^Es j the transition 
{ps,Hs) {a's,Hs) is possible. 
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Note that in the proof we have used the assumptions (i-iii) about the heat bath but not (iv). The latter wiU be 
used when we will need to get rid of the heat bath in the majorization expressions. 

Finally, it is intuitively obvious, that if we add to a heat bath a small system in a Gibbs state, this is again a larger 
heat bath, i.e. it still satisfies our assumptions. Indeed, consider a heat bath R which satisfies assumptions (i-iv), and 
another system S", and consider the total Hamiltonian being a sum of Hamiltonians Hfj +Hs'. The tensor product 
of two Gibbs states is a Gibbs state of a total system. Since the original heat bath is large, and our system is small, 
then the conditions HI [111 and Iml are obviously satisfied. Then, writing 

and using the property [iv] of one gets 

g^^'{E)^g^iE)Zs^ (C9) 

where Zs> is the partition function for S'. This implies, in particular, that g^^ also satisfies the condition Hvl 
This proves the following intuitively obvious lemma: 

Lemma 3. Transition between ps CE) ts' ^ (T5 (g) ts' is possible if and only if transition ps — )■ us is possible. 

Thus adding a system in a Gibbs state makes sense only, if we consider transition between systems with different 
Hamiltonian. Then we bring in a system in a Gibbs state, only in order to have that Hamiltonian in future processes 
e.g. we might then transform the Gibbs state into another state which needed to have that Hamiltonian. 

The conditions given thus far for state transformations are all that is needed to draw the full amount of work from 
a state, or to form a state from a heat bath. This is done in sections [Dl and lEl For the remainder of this section, we 
continue with more general state transformations. 



1. Thermo- majorization 

We shall now provide an efficient method of finding, whether a transition {p, H) (ct, H) is possible, for states 
which commute with Hamiltonian H. The condition of transformations of the diagonal part of a density matrix 
given by theorem[2]in terms of majorization involves not only the state, but also the heat bath, hence it is not always 
directly useful. We shall now express the condition given by majorization in terms of the states of system S themselves 
which will result in an efficient algorithm to decide whether a transition between two diagonal states is possible or 
not. Essentially, we need to write the eigenvalues of the state and heat bath, in terms of eigenvalues of only the state. 
We shall assume that our input state and output states are diagonal in their energy bases, however, even if they are 
not, the condition we derive determines possible transformations of the diagonal part of the density matrix, thus the 
condition becomes necessary, but ceases to be sufficient. 

Let PEs,g be eigenvalues of p and qEs,g be eigenvalues of a. Then, due to proposition [5] and the condition (pv|) . the 
state PePr ® PsPe after normalisation is close to the state having the following eigenvalues: 

^pEsPiEs^ (CIO) 

with multiplicity gii{E)e~^^^ , where Es runs over all energies of the system, and g runs over degeneracies. Similarly, 
PePr ® (JsPe has eigenvalues e~^^^ '^^^fin with the same multiplicity. 

The eigenvalues are very small, and they are collected in groups, where they are the same, hence the majorization 
amounts to comparing integrals. If one puts eigenvalues into decreasing order, one obtains a stair-case like function, 
and majorization in the limit will be to compare the integrated functions (which arc then piece- wise linear functions) . 

To sec how it works, we need to put the eigenvalues in nonincreasing order. The ordering is determined by the 
ordering of the quantities e^^^pEs,g- This determines the order of p{Es,g) (which in general will not be decreasing 
order anymore). We shall denote such ordered probabilities as pi, and the associated energy of the eigenstate as Ei. 
E.g. pi is equal to the p{Es,g) such that e^^^p{Es, g) is the largest. Note that for fixed Es the order is the same as 
order of Pes.qj while for different Es it is altered by the Gibbs factor. We do the same for cr, which results in qi. 

The eigenvalues are thus ordered by taking into account Gibbs weights: 



(CAl) 
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FIG. 4: Thermo-majorization. I. Standard majorization: (a) the histograms of probabihty distributions {pi} and {qi}. (b) 
The distribution {pi} majorizes distribution {qt} if for all I X]i=iP» — X]i=i9i- Graphically,this means that the entire plot 
corresponding to {pi} is above the plot corresponding to {qi}. II. Thermo-majorization. (c) Here the histograms consist of 
groups of numerous columns of the same height. We set their base to l/ds where ds = qr^E), which defines a stair-way 
looking function defined on interval [1,Z], where Z is partition function. As a result, the plot analogous to that of (b), in 
the limit of large E (which implies — >■ oo) becomes integral of that function presented on panel (d). The angles are given 
by tan(Q:i) = pte^^' hence they are decreasing, (e) checking thermo-majorization conditions amounts to comparing the plots 
which are piecewise linear functions. The state pi thermo-majorizes each other state, while the thermal r is thermo-majorized 
by all other states. Thus we can transform pi into p2, pa and r and all states can be transformed into r. On the other hand, 
P2 and p3 are incomparable, hence neither can be transformed into one another by Thermal Operations. 



where is a shorthand for gfi{E). We shall now ascribe to vector {pi} a function mapping interval [0, Z] into itself. 
On the y axis, we put subsequent sums X]i=iPij / = 1, . . . , d where d is the number of all probabilities, and on the x 
axis, we put sums X]i=i e~'^^S with the final point being at x = Z. This gives d -|- 1 pairs: (0, 0), {pi,e~^^^), {pi + 
P2, e~^^^ + e~^^'^), . . . ,{Z, 1). We join the points, and it will gives us a graph of a function, fp{x). It is easy to see, 
that in the limit of large gii{E), the eigenvalues of p majorize eigenvalues of a if and only if fp{x) > fq{x) for all 
x S [0, Z]. The described scheme is presented on figure [CT] 

Note that the Gibbs state in this picture is represented by a trivial function f[j{x) ~ Zx hence any state can be 
transformed into a Gibbs state. Note that one can generalise our new type of majorization, by replacing Gibbs state 
with an arbitrary state, obtaining an interesting mathematical generalisation of standard majorization. Likewise, 
although here the relevant conserved quantity is energy, one can generalise to operations which commute with any 
conserved quantity. 



Appendix D: Transitions involving pure excited states 



In preparation for deriving the expression for extracting work from a resource, or forming a state from the thermal 
state by adding work, we will derive the condition for transitions involving a pure energy eigenstate. In particular, 
we will derive the expression for extracting a pure excited state, and the expression for forming a state from a pure 
excited state. Then in Section |E1 we will use the results in this section to derive our two free energies. 



1. Distillation: extracting a pure excited state 



In this section we derive the condition for when a given mixed state ps with Hamiltonian Hs can be transformed 
into a pure excited state - an eigenstate of the Hamiltonian Hs' with eigenvalue W . Let us first consider the case 
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where we wish to extract ipw with no probabiUty of failure, from a state diagonal in the energy basis. We will then 
extend our result to arbitrary states. 

According to Lemma [3] we need to take an initial state ps <E) ts' and the final state is an arbitrary state of the 
system SS' of the form as ® \ip'^){ip'^\s'- Due to Theorem[2J and Eq. (jC9p a transition is possible when the state 

^Ve-Es^PesPsPes (D1) 

Es 

majorizes 

^V§-Es-w ® Pes^Pes ® \'il^w) S' {il^w\ (D2) 

Es 

However, since cr is arbitrary, and the target state of S' is pure, this is equivalent to the condition 

ranki„ > ranko„t. (D3) 



(D4) 



where ranki„ and rankout are ranks of the state (jDl[) and (jD2[) . respectively. 
The rank of the initial state is equal to 

rankin = ^gRS'{.E - Es)va.nVEs{.Ps) 

Es 



where rank£;g(p) is the rank of PesPsPesj ^-nd as in Eq. IC9I 

gRS'{E~Es)=gRiE-Es)Zs,. (D5) 
The maximal rank of the target state is given by 



mnKut = 9r{E -Es- W)gs{Es) 

Es 

Now, using (|D5l) and gR{E + AE) w gR{E)e^^^ we obtain that eq. |D3] implies 

e-PiEs) e-/9(iSs-' 



(D6) 



Yl — z — ^'^^^^EsiPs) < Y — Y' — ^^^^^s' (V'w) (D7) 

Es Eqi 



which can be written as 



Drain{ps\\Ts) > ^min (V-S^ 1 1 TS' ) (D8) 

with -Dinin(ps'| I'J's) '■= — IntrllpT. In general this quantity is the min-relative entropy [23|. 

We can now ask about the case when p is not diagonal in the energy eigenbasis. In such a case, we simply replace 
p with u! = J^Eg g' , g) {E , g\pi\E , g') (E , g' \ in Equation (|D8I) . The reason, is that Theorem [5] states necessary and 
sufficient conditions for transforming the diagonal entries of one density matrix into the diagonal entries of another. 
In the case of an initial state with off-diagonal entries, it gives necessary conditions. However the diagonal entries of 
a pure excited energy eigenstate determines uniquely that state itself, thus the condition must also be sufficient. An 
alternative argument in terms of commuting of the dephasing operation and thermal operations is given in the Main 
Section. 

Note that the operation which gets implemented to map one state to another is simply a mapping from eigenstates 
of the initial state within each energy block E, to mappings of eigenstates of the final state within the same energy 
block. However, any such mapping will do, and there are a huge number of them. Thus the experimenter does not 
need to know which unitary she is implementing, provided that it conserves energy. She thus needs very little control 
over her systems - she simply chooses any unitary which maps the macroscopic variables of one state (in this case, 
total energies {Er,Es), to macroscopic variables of the final state (in this case, a pure energy eigenstate with no 
degeneracy on some system, and total energy on another {Er + Es — W). The same is true of the formation process 
described in the next section. 
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2. Formation of a resource state from a thermal bath and pure excited state 

Just as one can draw work from a state which is out of equihbriuni from the rest of the thermal bath, it is also 
possible to perform the reverse process - create a state from the thermal bath by adding work. Here we provide 
conditions for transition from a pure excited state to a given target diagonal state. We will then use it in Section lEl 
to derive the amount of work which is required to create a state. 

We thus take the initial state to be of the form 

=^^J ® TS' (D9) 

and the output state 

= Pss' (DIO) 
We shall now use Theorem [2j To this end we have to check the majorization condition between the following states: 

and 

where in (jPlip we have used Eq. (|C9|) . 

However, the former state has only one eigenvalue \/gRS'{E — W) with multiplicity gus'iE — W\ Therefore, the 
majorization condition is that all eigenvalues of the latter state arc no greater than this eigenvalue. I.e. we need that 

gRs\E - Wy^ > gnsiE - Es')-^\T^ (D13) 

holds for all Egi , where A^^^ is the maximal eigenvalue of PEg, Ps' Pec,' it is the maximal eigenvalue of ps' in the 
subspace of energy Es'- Since the Hamiltonian for RSS' is the sum of Hn, Hs and Hs', we obtain that 



gRS'{E ~ W) = Y.9b{E -W- Es')g's{Es') 

Es, 

gRs{E - Es') - - Es' - Es)gsiEs) 



Es 

Now we use the fact that i? is a heat bath, and we apply our assumption (|A4[) which says that 

gniE -W^Es-)^ 5i?(£^)e-^(^+^-'' (D14) 

and 

gniE - Es' - Eg) - gR{E)e-^'^^'^''^-^ (D15) 
we can thus rewrite the majorization condition (jD13[) as follows 

for all Es'. On the other hand, one can compute that 

i^max(V'^llTs) = Zse^"^, i?„,ax(ps'lks') = max 6^^^' A'i;^ (D17) 

where Z?,„ax(p| I"?") logmin{A : p< At} is the max- relative entropy [23. Thus, the transition (^/j^, iJs) — > {ps',Ets') 
is possible if and only if 
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Appendix E: Extractable work, and work of formation 



We now use the results of Sees. ID 21 and ID II to discuss the amount of work that can be drawn from a system m 
contact with a heat bath of temperature T, and the amount of work that is needed to create one. In thermodynamics, 
both quantities are equal and are given by free energy. In our case we obtain two free energies, i^mm governing 
extracting work, and the other, Fmax, governing creation of the system. In this section, we derive the expression for 
F^in and F^ax in the case where we wish to extract the full amount of work available, or create a total state out 
of thermal states. This corresponds to Equations (jSj and The more general result of Equations (fTO|) and (fTTj) 
following from thermo-majorization is contained in the Main Section. 

We propose to define the process of drawing or spending work as raising or lowering the energy level of an eigenstate 
of a Hamiltonian of a system. This system is used to store the energy provided by drawing work. Thus we draw 
work AW if we transform a state \E) into \E') such that E' — E ~W Hw\E) = E and H\E) = E. Expending work, 
would mean the reverse process. Since our results don't depend on the system used to store work, we take the most 
elementary system than can be used, namely a two level system with energy gap W . 

Thus consider a system S in state ps- We add a work system with Hamiltonian in a state \E). Our initial state 
is thus Ps ® \E){E\ and the final state \E'){E'\. Using the results of section [DT] we obtain, that ps ® \E){E\ can be 
transformed into \E'){E'\ if and only if 

Ani„(pS ® \E){E\) > A„in(|^')(^'l), (El) 

where we use the shorthand notation -Dmin(p) = ^min(p|''"). Since Z?niin is additive, and for energy eigenstates \E) we 
have 

D^,U\E))^ pE-\nZw (E2) 
where Z is the partition function of the work system, we can rewrite (|E1[) as 

kTDn,in{ps) > W (E3) 

This allows us to define the free energy Fmin as follows: 

Fmin — Fp 

+ kTD,mn (E4) 

where _Fg is the standard free energy of the equilibrium state (we have anyway that for thermal states Fmin = Fp). 
The work that can be drawn from a non-equilibrium state is thus equal to the the free energy difference AFmin' 

Wdistip) = Fmin{rho) - F„Hn{tau) (E5) 

We now wish to allow some probability of failure (2^ - namely, we might not produce tp^) exactly, but rather a 
state ijj^ e-close to tp^ i.e. such that 

Wi;^ -i:^\\<e. (E6) 

Since thermal operations are completely positive trace preserving maps, then if we imagine the same operations were 
performed on some initial state — p|| < e then the final state will also satisfy Equation (IE6p. We can thus replace 
F>minip\\T) with D^j„(yo||r) := — sup^^ — IntrllpT. This is known as the smooth-min entropy |23l|. 

Analogously we define work which is needed to create a system, i.e. we consider a transition \E){E\ \E'){E'\®ps, 
and in an analogous way obtain that the minimal work W = E' — E to ensure this transition is given by 

Wformip) = Fmaxip) " -^maa; (t) (E7) 

where F,n.ax is a max-free energy given by 

Frnax — Fp + kTDmax- (E8) 

This comes from simply solving Equation (jDlSp for the value of W required for the transition, to obtain 

W = kT inf log min{A : p < \t] (E9) 

As in the distillation process, we can consider e-closc formation processes, since we will generally want to tolerate 
some small error in the creation of a resource, particularly if it can save us needing a large amount of work. We thus 
obtain the expression for F™°-^ in the Main Section. 
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FIG. 5: Transitions for two level system with energy levels E = and E — 1. a) There are four possible transitions b) the 
number of states of bath corresponding to each level is proportional to the Boltzmann factor. 



Appendix F: Characterisation of Thermal Operations 

We have provided an algorithm for deciding whether a state can be transformed into another state, given by 
thermo-majorization. However the algorithm does not tell us what kind of operations (completely positive maps) we 
can perform by means of Thermal Operations. Below we shall show, that all possible processes are precisely those 
that preserve the Gibbs state. This implies that if we have reversibility of state transformations (as is the case when 
we have many copies of a state[2l|), then the unique measure which determines whether a transformation is possible, 
is given by the relative entropy distance to the Gibbs statefl^]. This quantity is the difference between free energy 
of a state of interest and that of Gibbs state [23|. However, here, we do not have reversibility, thus there are at least 
two inequivalent functions which are non increasing under thermal operations {Fmin and Fmax)- 

We start with a state (E) ps and write 

TR®ps^^ PePrs (F1) 

with 

Prs^^Petr^PsPe (F2) 

^E 

where £ consists of very large energies in comparison with system energies, and = tr(Tfl ® PsPe)- We shall now fix 
one energy block, and show, that even when restricting just to permutations of basis vectors within the block (being 
products of eigenstatcs of tr to eigenvalues Er and eigenstates of ps to eigenvalues Es, such that Er + Es = E) we 
can perform arbitrary operation on system S which preserve the Gibbs state. Then, we will argue that the operation 
on the system S can be made the same for each energy block (for E G £). 

To prove the first claim, for simplicity, let us assume that the Hamiltonian Hs is nondegenerate (extension to the 
degenerate case is immediate). As follows from Theorem [2l in such a fixed subspace, the eigenvalues of our state 
form groups labelled by energy Es- Within each group, we have gR{E)e~^^^ eigenvalues all equal to gj^^E)e-i^'^s ■ 
Permutations of basis vectors result in transferring some subsets of a given group to other groups. Let us then use 
indices i in place of Es, so that pEs Pi and gR{E)e~^^^ — >■ di. We shall denote by ki^j the "transition current" 
i.e. the number of eigenstates that have been moved from the i-th group to the j — th group. Clearly ki^j satisfy 



^ ^ ki^j — di 



Y^k 



~d (F3) 



The transition " currents" are illustrated on Fig. [S] After an operation given by some fixed set of ki^j satisfying the 
above transitions, we obtain a new state, whose probabilities qi are given by 

P 



d 

■I 

Thus, we can define transition probabilities Pi^j as 



(l]=Yh^jj (F4) 
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FIG. 6: Quasi-cycles. a) In quasi cycle for each level there is only one transition to a different level b) quasi-cycle for three 
level system. The points represent levels with energies 0, 1 and 2; probability p2->2 of staying in level 2 vanishes, c) Currents 
for three-level quasi-cycle: the shaded microstates are subjected to a cycle, while the ones not shaded are left untouched. 

Then the condition (|F3|) means that the Pi^j ensure normalisation, so that the only constraint on possible process 
is (|F3I) . However, since 4^ = ^wsr, the latter condition means simply that the Gibbs state is preserved. This ends 
the proof, that for fixed E we can perform all Gibbs preserving operations. Finally, given arbitrary Gibbs preserving 
transformation on S we perform for every total energy block permutation that results in this transformation. In 
this way the needed transformation is performed on the initial state of system S. Of course. Thermal Operations 
obviously do preserve Gibbs state, hence we obtain, that Thermal Operations are arbitrary operations that preserve 
Gibbs state. 

Let us discuss this result in the context of the detailed balance condition. The latter is the property that ^^-^ = 
g-l3{Ej-Ei) ^ As we will sec. Thermal Operations need not satisfy detailed balance; they should merely preserve the 
Gibbs state as a whole. To provide an example, let us distinguish a class of Gibbs-preserving processes called quasi- 
cyclcs: wc put the energy levels on a circle, and from one level, one can go only to the next neighbouring level, as in 
Figure |6] 

The simplest description of a quasi-cycle is in terms of quantities ki^j. Namely, we choose an order of levels, put 
them on a circle, fix a direction, and the process is to take all states from the group of states with the largest energy 
Es^ and shift them to the states with the energy level in the chosen direction. I.e. the process is determined by 
= where i?max is the maximal energy, and Ei is the energy oi i — th level. 

For two level systems, the class of Gibbs preserving operations is the same as the class of operations satisfying 
the detailed balance condition, and all possible processes are parametrised by a single number r S [0,1], which is 
the probability of mixing two basic processes: the identity operation, and the two-level quasi-cycle. For three level 
systems, there are processes that preserve the Gibbs state, but do not satisfy detailed balance, an example being the 
three-level quasicycle. It turns out that the class of Gibbs preserving maps is strictly more powerful that the class of 
detailed-balance maps. An example is the transition between (0, \,frac\2) and (^e~^^, ^(1 — e~/3), \{e~^ — e~^^ -I- 1) 
with the energy levels given by (0, 1, 2). It turns out that the only Gibbs preserving operation that can transform the 
first state into the second one is the quas i-cycle — > 1 — 2. This means that such a transition is impossible by means 
of weak coupling with the heat-bath [34| , as at weak coupling the detailed balance condition is satisfied. 



